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ON THE FOURIER-JACOBI MODEL FOR SOME ENDOSCOPIC ARTHUR 
PACKET OF U(3) x 17(3) : THE NON-GENERIC CASE 

JAEHO HAAN 


Abstract. For a generic L-parameter of U{n ) x U(n), it is conjectured that there is a unique represen¬ 
tation in their associated relevant Vogan L-packet which produces the unique Fourier-Jacobi model. We 
investigated this conjecture for some non-generic L-parameters of 17(3) x 17(3) and discovered that this 
conjecture is still true for some non-generic L-parameter and false for some non-generic L-parameter. In the 
case when it holds, we specified such representation under the local Langlands correspondence for unitary 
group. 


1. Introduction 

The local Gan-Gross-Prasad conjecture deals with certain restriction problems between p-adic groups. 
In this paper, we shall investigate it for some non-generic case not yet treated before. 

Let E/F be a quadratic extension of number fields and G = U( 3) be the quasi-split unitary group of 
rank 3 relative to E/F. Then H = U{2) x U( 1) is the unique elliptic endoscopic group for G. In 23] . 
Rogawski has defined a certain enlarged class of L-packets, or A-packets, of G using endoscopic transfer 
of one-dimensional characters of H to G. In more detail, let g = <S) v g v be a one-dimensional automorphic 
character of H. The A-packet II(^) ~ <8>II(g> 1 ,) is the transfer of g with respect to functoriality for an 
embedding of L-groups £ : L H ~^ L G. Then for all places v of F, n(^,) contains a certain non-tempered 
representation TT n (g v ) and it contains an additional supercuspidal representaton ir s (g v ) precisely when v 
remains prime in E. Gelbart and Rogawski [12] showed that the representations in this A-packet arise 
in the Weil representation of G. Our goal is to study the branching rule of the representations in this 
A-packet. 

For the branching problem, there is a fascinating conjecture, the so-called Gan-Gross-Prasad (GGP) 
conjecture, which was first proposed by Gross and Prasad [7] for orthogonal group and later they, together 
with Gan, extended it to all classical group in |6j. Since our main theorem has to do with it, we shall give 
a brief review on the GGP conjecture, especially for unitary group. 

Let E/F be a quadratic extension of non-archimedean local fields of characteristic zero. Let 14 +i be a 
Hermitian space of dimension n + 1 over E and W n a skew-Hermitian space of dimension n over E. Let 
V n C I4+i be a nondegenerate subspace of codimension 1, so that if we set 

Gn = U(U n ) x U(U n+1 ) or U(II4) x U(W n ) 

and 

H n = U(I4) or U(W n ), 
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then we have a diagonal embedding 

A : H n G n . 

Let 7 r be an irreducible smooth representation of G n . In the Hermitian case, one is interested in 
computing 

dime HomAE„ (vr, C). 

We shall call this the Bessel case (B) of the GGP conjecture. For the GGP conjecture in the skew- 
Hermitian case, we need to introduce a certain Weil representation cu,/, iX .vi/ n of H n , where if is a nontrivial 
additive character of F and x is a character of E x whose restriction to F x is the quadratic character 
oje/f associated to E/F by local class field theory. (For the exact definition of ca^ jX: w n , please refer to 
Section. O) In this case, one is interested in computing 

dime Hom Aj Ffj7r,uty )X)Wn ). 

We shall call this the Fourier-Jacobi case (FJ) of the GGP conjecture. To treat both cases using one 
notation, we shall let v = C or c ^, x ,w n i 11 the respective cases. 

By the results of [1] [25] , it is known that 

dim c Horn AH n {n,v) < 1 

and so the next step is to specify irreducible smooth representations 7r such that 

Rom AHn (TT,u) = 1. 

(A non-zero element of Hom A # n (7r, v) is called a Bessel {Fourier-Jacobi) model of 7r in the (skew) her¬ 
mitian case.) 

In [6|, Gan, Gross, Prasad has brought this problem into a more general setting using the notion of 
relevant pure inner forms of G n and Vogan L-packets. A pure inner form of G n is a group of the form 

G' n = U(k')xU(F' +1 ) or U(W')xU«) 

where Vf C Vf +1 are n and n + 1 dimensional hermitian spaces over E and IT)) , IF// are n-dimensional 
skew hermitian spaces over E. 

Furthermore, if 

VUi/Vn = V n+1 /V n or W' n = W'l 
we say that G' n is relevant pure inner form. 

(Indeed, there are four pure inner forms of G n and among them, only two are relevant.) 

If G' n is relevant, we set 

K = U(T') or U«), 

so that we have a diagonal embedding 

A : K G' n . 

Now suppose that <j) is an L-parameter for the group G n . Then the (relevant) Vogan L-packet 11^ 
associated to i j> consists of certain irreducible smooth representations of G n and its (relevant) pure inner 
forms G' n whose L-parameter is q i>. We denote the relevant Vogan L-packet of </> by 11^. 

With these notions, we can loosely state the result of Beuzart-Plessis mmm) for Bessel case and 
Gan-Ichino ([9]) for Fourier-Jacobi case as follows : 

Theorem 1.1. For a tempered L-parameter cj) of G n , the followings hold: 

(i) E7r'en« dim c H om A H;(7r',zz) = 1. 
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Using the local Langlands correspondence for unitary group, we can pinpoint the unique tt' £ 
such that 

dime Hornu) = 1. 


To emphasize its dependence on the number n, we denote the Bessel and Fourier-Jacobi case of 
Theorem 1.1 as (B) n and (FJ) n respectively, and later we shall elaborate more on this notation. 

The GGP conjecture predicts that this theorem also holds for a generic L-parameter cj) of G n . 

Our main theorem is to investigate (FJ )3 for some L-parameter of G 3 involving a non-generic L- 
parameter of U{W%). More precisely, we have 

Main Theorem. For an irreducible smooth representation n 2 ofU{W, 3 ), let it = TT n (g) (g> 712 as a repre¬ 
sentation of G 3 . Then 

(i) HoniAHj ("7T, Wi/>,x,iu 3 ) = 0 if ^2 is not a theta lift from U(V 2 ). 

(ii) Assume that tt 2 is the theta lift from U(V() and let f = <p n ( g> 0 2 be the L-parameter of tt. Then 

X] dime Horn A (tt' ,^,X,W 3 ) = 1- 
Tr'enj 

(iii) Using the local Langlands correspondence for unitary groups, we can explicitly describe the rep¬ 
resentation tt' £ n£ appearing in (ii) such that 

dim c Hom A/ /'(7r',wV’,x,M / 3) = l - 

Remark 1.2. As we shall see in Theorem 13.21 the L-parameter of TT n (g v ) is not only non-tempered but 
also non-generic. Thus if we choose the L-parameter of f 2 in cf apart from those obtained by the theta 
lift from t7(V 2 ) to U(Ws), then the first part of the Main Theorem tells us that the GGP conjecture may 
not be true for non-generic L-parameter of G n . 


The proof of Main Theorem is based on the following see-saw diagram 

U(W 3 ) X U(W 3 ) U(F 2 ) 


U(W 3 ) 



U(Vi) x U(Vi) 


Since all elements in the A-packet n(£>) can be obtained by theta lift from U(Vi), we can write TT n {g) = 
©i/),x,w 3 ,Vi (c) where a is an irreducible smooth character of U(V\) and are some characters, which 
are needed to fix a relevant Weil representation. Then by the see-saw identity, we have 

Hom [f(I y 3) (0^ x ,w 3 ,Vi (<r) ®u%,x,W a > 7r 2) - H onr u(Vl )(&,/,, x ,v 2 ,w 3 (^), a). 

From this, we see that for having Hoi tn[/(w 3 )(@if’, x ,w 3 ,Vi( 0 ') ® wY x w 3 > 7r 2 ) 7 ^ 0, it should be preceded 
®b,x>v r 2 ,iu 3 ( 7r 2 ) 7^ 0- This accounts for (i) in the Main Theorem because 

Homj/(jy 3 ) (0i/>, x ,W3,Vi (°") ® Wv’, x ,w 3 ) 7r 2 ) — Hom u(iu 3 )(0V’AW3,Vi( cr ) <S>tt2 ,^, x , w 3 )- 

If ©i/ ) ,xT 2 ,w 3 ( 7r 2 ) 7^ 0) then by the local theta correspondence, irf should be ©^ lX ,w 3 ,v 2 (^ 0 )) where zro is 
an irreducible representation of UiVf). By applying (B)i, we can pinpoint 7To and a in the framework of 
local Langlands correspondence such that Homj^y^TTo, a) / 0. Next we shall use the precise local theta 
correspondences for (U(Vi),U(W 3 )) and (U(Vi), UiWif) in order to transfer recipe for (B)i to (FJ) 3 . 

The rest of the paper is organized as follows; In Section 2, we shall give a brief sketch of the local 
Langlands correspondence for unitary group. In Section 3, we collect some results on the local theta 
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correspondence for unitary group which we will use in the proof of our main results. In Section 4, we 
shall prove our Main Theorem. 

Acknowledgements. The author would like to express deep gratitude to professor Haseo Ki for intro¬ 
ducing him this research area. The influence of the work of Gan and Ichino [9] on this paper is obvious to 
the reader. We are grateful to professor Atsushi Ichino for his kind suggestion to pursue the non-tempered 
aspects of the GGP conjecture. The author expresses his deepest thanks to the referee for his many in¬ 
valuable comments and bringing our attention to the work of H.Atobe and Gan [2] containing Theorem 4.1 
and Proposition 5.4, both of which are crucial to prove our main theorem. This work was supported by the 
National Research Foundation of Korea(NRF) grant funded by the Korea government(MSIP)(ASARC, 
NRF-2007-0056093). 

1.1. Notations. We fix some notations we shall use throughout this paper: 

• E/F is a quadratic extension of non-archimedean local fields of characteristic zero. 

• c is the non-trivial element of Gal(E/F). 

• Fr^ is a Frobenius element of Ga l(E/E). 

• Denote by Tr E / F and N E / F the trace and norm maps from E to F. 

• 5 is an element of E such that Tr E / F (S) = 0. 

• Let iJj be an additive character of F and define 

fp E (x) := Tr e /f(Sx)) and V#0*0 : = ^C^E/F^x)). 

• Let x be a character of E x whose resriction to F x is a > E /p, which is the quadratic character 
assosiated to E/F by local class held theory. 

• For a linear algebraic group G, its T-points will be denoted by G(F ) or simply by G. 


2. Local Langlands correspondence for unitary group 

By the recent work of Mok [22j and Kaletha-Mmguez-Shin-White m, the local Langlands correpon- 
dence is now known for unitary group conditional on the stabilization of the twisted trace formula and 
weighted fundamental lemma. The twisted trace formula has now been stabilized by Waldspurger |28j— 
[35] and Moeglin-Waldspurger [20]—[21] and the proof of the weighted fundamental lemma is an ongoing 
project of Chaudouard and Laumon. Since our main results are expressed using the local Langlands 
correspondence, we shall assume the local Langlands correspondence for unitary group. In this section, 
we list some of its properties which are used in this paper. Indeed, much of this section are excerpts from 
Section.2 in [9] . 

2.1. Hermitian and skew-Hermitian spaces. For e = ±1, let V be a finite n-dimensional vector 
space over E equipped with a nondegenerate e-hermitian c-sesquilinear form (v)v : V x V -> E. That 
means for v, w £ V and a, b £ E, 

(av, bw)v = ab c (v , w)y, (w, v)y = £■ (v, w)y. 

We define disc V = (—l)( n_1 ) n / 2 . d e t V, so that 


discK G 


F x /K e/f {E x ) iie = +1; 
5 n ■ F x /N e/f (E x ) if e = — 1 
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and we can define e(V) = ±1 by 


( 2 . 1 ) 


e(V) 


W £/F(disc V) if e = +1; 

^e/f^ -71 ‘ disc V) if s = — 1. 


By a theorem of Landherr, for a given positive integer n, there are exactly two isomorphism classes of 
e-hermitian spaces of dimension n and they are distinguished from each other by e(V). 

Let U(P) be the unitary group of V defined by 

U(F) = {g £ GL(P) | ( gv,gw)v = ( v,w)y for v,w £ V}. 

Then U(V) turns out to be connected reductive algebraic group defined over F. 


2.2. L-parameters and component groups. Let Ip be the inertia subgroup of Ga \(F/F). Let Wp = 
Ip x (Frp) be the Weil group of F and WDp = Wp x SL 2 (C) the Weil-Deligne group of F. For a 
homomorphism cj) '■ WDp —> GL n (C), we say that it is a representation of WDp if 


(i) 4> is continuous and 0(Fr p) is semisimple, 

(ii) the restriction of to SL 2 (C) is induced by a morphism of algebraic groups SL 2 —> GL n 


If moreover the image of Wp is bounded then we say that cf is tempered. Define </> v by cjF (vj) = t (f{w ) _1 
and call this the contragredient representation of <f>. If E/F is a quadratic extension of local fields and is 
a representation of WDp, fix s £ Wf \ We and define a representation (j) c of WDp by cj) c (w ) = 4>(sws ~ x ). 
The equivalence class of (j) c is independent of the choice of s. We say that <j) is conjugate self-dual if there is 
an isomorphism b : (f> 1 —> (^> v ) c . Note that there is a natural isomorphism (((</> v ) c ) v ) c — (j> so that (b v ) c can 
be considered as an isomorphism from cj) onto (</> v ) c . For e = ±1, we say that cj) is conjugate self-dual with 
sign e if there exists such a b satisfying the extra condition (6 V ) C = e ■ b. Define As(0) : WDp —> GL n 2 (C) 
by tensor induction of 0 as follows; 


As(4>)(w) 


<t>(w) <g> (f){s 1 rcs) if w £ WDp 

1 o (8) 4>(ws)) if ic £ WDp \ WDp 


where l is the linear isomorphism of C n (8> C n given by i(x <8> y) = y ® x. 

Then the equivalence class of As (cj)) is also independent of the choice of s. We set As + ((/>) = As(</>) and 
As ~{4>) = As(y <S> <j>). 

Let V be a n-dimensional e-hermitian space over E. An L-parameter for the unitary group U(V) is a 
GL n (C)-conjugacy class of admissible homomorphisms 

0 : WDp —> L U(V) = GL n { C) x Gal (E/F) 


such that the composite of with the projection onto Gal(E/F ) is the natural projection of WDp to 
Gal(E/F). 

The following proposition from [6j §8] enables us to removes the cumbersome Gal(.E/.F)-factor in the 
definition of L-parameter of U(V). 


Proposition 2.1. Restriction to WDp gives a bijection between the set of L-parameters for U(V) and 
the set of equivalence classes of conjugate self-dual representations 

(f> : WDp —* GL n ( C) 


of sign {—\) n - 1 . 
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With this proposition, by an L-parameter for U(V), we shall mean a n-dimensional conjugate self-dual 
representation </> of WDe of sign (—l) n_1 . 

Given a L-parameter <f> of U(V), we say that 4> is generic if its adjoint L-function L(s, Ad o (f>) = 
L(s, As^ -1 ^" ( cj ))) is holomorphic at s = 1. Write cj) as a direct sum 

(t> = @ mfa 

i 

of pairwise inequivalent irreducible representations fa of WDe with multiplicities rn t . We say that <j> is 
square-integrable if it has no multiplicity (i.e. = 1 for all i) and fa is conjugate self-dual with sign 

(—l)™^ 1 for all i. Furthermore, we can associate its component group S$ to (j). As explained in [6, §8], 
Sff, is a finite 2-abelian group which can be described as 

S* = JJ(Z/2Z)aj 
i 

with a canonical basis {a,j}, where the product ranges over all j such that cj)j is conjugate self-dual with 
sign (—l) n . If we denote the image of —1 £ GL n (C) in by z^, we have 

z<t> = ( rrijCLj ) £ H(Z/2Z) aj . 

3 

2.3. Local Langlands correspondence for unitary group. The aim of the local Langlands corre¬ 
spondence for unitary groups is to classify the irreducible smooth representations of unitary groups. To 
state it, we first introduce some notations. 

• Let V + and V~ be the n-dimensional e-Hermitian spaces with e(V + ) = +1, e(V~ ) = —1 respec¬ 
tively. 

• Let Irr(U(V ± )) be the set of irreducible smooth representations of U(y ± ). 

Then the local Langlands correspondence a form enhenced by Vogan [26], says that for a L-parameter 
(j) of U{Vfa, there is the so-called Vogan L-packet II^, a finite set consisting of irreducible smooth 
representations of L’(V r± ), such that 


Irr(U(V+)) U Irr(U(V-)) = |J H 0 , 

<t> 

where cj) on the right-hand side runs over all equivalence classes of L-parameters for U(V ± ). Then under 
the local Langlands correspondence, we may also decompose II^ as 


n 0 = n;un-, 

where for e = ±1, 11^ consists of the representations of U(V e ) in IT 
Furthermore, as explained in [6] §12], there is a bijection 

J^(fa) : n 0 Irr(5 0 ) 


which is canonical when n is odd and depends on the choice of an additive character of ip : F x ^ C 
when n is even. More precisely, such bijection is determined by the Ne/f(E x )-orbit of nontrivial additive 
characters 


i/j e :E/F^C x if e = +1; 
V>:F-MC X if e = —1. 
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According to this choice, when n is even, we write 

jip _ I if £ = +1; 

[J^ if £ = — 1 , 

and even when n is odd, we retain the same notation for the canonical bijection. 

Hereafter, if a nontrivial additive chracter i/j : F —>• C x is fixed, we define ijj E : E/F —>• C x by 

i/j E (x) := i>(\Tv E/F (5x)) 

and using these two characters, we fix once and for all a bijection 

-A Irr(S 0 ) 

as above. 

With these fixed bijections, we can label all irreducible smooth representations of as rj) for 

some unique L-parameter cj) of U(V E ) and rj € Irr(S^). 


2.4. Properties of the local Langlands correspondence. We briefly list some properties of the local 
Langlands correspondence for unitary group, which we will use in this paper: 


• 7 r((j),r)) is a representation of U(D e ) if and only if rj(z^) = e. 

• 7 r(</>, rj) is tempered if and only if cj) is tempered. 

• 7r(</>, 77 ) is square-integrable if and only if cj) is square-integrable. 

• The component groups and S^v are canonically identified. Under this canonical identification, 
if 7r = 7 r(</>, 77 ), then its contragradient representation 7r v is 7r(^> v , 77 ■ v) where 


u(oj) 


ue/f(~ l) dim A; if dime 4> is even; 
1 if dime 4> is odd. 


(This property follows from a result of Kaletha [181 Theorem 4.9].) 


3. Local theta correspondence 

In this section, we state the local theta correspondence of unitary groups for two low rank cases. From 
now on, for e = ±1, we shall denote by V£ the 77-dimensional Hermitian space with e(V^) = e and by 
the n-dimensional skew-Hermitian space with e(W^) = e, so that W* = 6 ■ V*. 

3.1. The Weil representation for Unitary groups. In this subsection, we introduce the Weil repre¬ 
sentation. 

Let E/F be a quadratic extension of local fields and (V m , (, )y m ) be a 777,-dimensional Hermitian space 
and (W n , (, )w n ) a 77 -dimensional skew-Hermitian space over E. Define the symplectic space 

Wu m ,lUn := Res E /p V m W n 

with the symplectic form 

(v 0 w, v' <8> w')w Vm , Wn ■■= \ tr E/F ((v, v') Vm (w, w') w J . 

We also consider the associated symplectic group Sp(Wv m ,w„) preserving (-, -)wv m Wn an< ^ ^he me t a pl ec ti c 
group Sp(Wv rn ,w„) which sits in a short exact sequence : 


1 ^ c x ^ Sp(W VmjWn ) -a Sp(W Vm , w J -> 1. 


JAEHO HAAN 


Let '^■Vm.Wri be a Lagrangian subspace of Wy m> w„ and fix an additive character i/j : F —y C x . Then 
we have a Schrodinger model of the Weil Representation of Sp( W) on «S(Xy m) w„), where S is the 
Schwartz-Bruhat function space. 

If we set 

XVm ■■= X m and xw n := X™, 

where x is a character of E x whose resriction to F x is <jJe/Fi which is the quadratic character assosiated 
to E/F by local class field theory, then (xv m - Xw„) gives a splitting homomorphism 

L xv m ,xw„ ■ U(V m ) x U(W n ) -> Sp(W Vm , Wn ) 

and so by composing this to uty, we have a Weil representation o l Xv , Xw of U(V m ) x U(W n ) on 

s ( x w,wJ- 

When the choice of if and (xVm > Xw n ) is fixed as above, we simply write 

: = ° L xv m ,xw n ■ 

Throughout the rest of the paper, when it comes to a Weil representations of U(V m ) x U(W n ), we shall 
denote it by ^,w n ,v m with understanding the choices of characters (xv rn , Xw „) as above. 

Remark 3.1. When m = 1, the image of U(V\) in Sp(Wv 1 ,w n ) coincides with the image of the center of 
U(W n ), and so we regard the Weil representation of U(V\ ) x U(W n ) as a representation of U(W n ). In this 
case, we denote the Weil representation of U{W n ) as Furthermore, we can also use xvi = X for 

the choice of splitting homomorphism t XVi tXw instead of = X- In this case, the Weil representation 
of U(W n ) is U3^ >Wn . 

3.2. Local theta correspondence. Given a Weil representation u)d,w n ,Vm °f U(V m ) x U(W n ) and an 
irreducible smooth representation ir of U(IT n ), the maximal 7r-isotypic quotient of ai^y rn .w n is of the form 

for some smooth representation 0^,,y m ,w„( 7r ) of U(I4i) of finite length. By the Howe dualitjO, the maximal 
semisimple quotient of ®-4>,Vm,Wn( 7T ) i s either zero or irreducible. 

In this paper, we consider two kinds of theta correspondences for (U(l) x U(3)) and (U(2) x U(3)) : 


3.3. Case (i). Now we shall consider the theta correspondence for U(I / 1 <E ) x U(WJ ). The following is a 
compound of Theorem 3.4 and Theorem 3.5 in 1113 - 

Theorem 3.2. Let <f> be a L-parameter of U ( V ±). Then we have: 


(i) For any e, e' 

(II) ( 7r ) 

where 


= ±1 and any vr € U e ^, 0^ W j jV? '( 7r ) 

{ a non-tempered representation 
a supercuspidal representation 


is nonzero and irreducible. 

if z{\A®X~*A%) = e-e' 
if ® X -3 = -€■<? 


= if(Tr E/F (Sx)). 


Tt was first proved by Waldspurger m for all residual characteristic except p = 2. Recently, Gan and Takeda m, in 
have made it available for all residual characteristics. 
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(iii) The L-parameter 6(f) of 0^ we ye 1 (ft) has the following form; 


(3.1) 


0(f) 


0 n (f) =x\ • Ve®4>-X 2 ©xl ■ \e 2 ift(bf®X 3 ,f 2 ) = e-e' 

0 s (f) = f- x~ 2 ©X^ s 2 if e(\,f®x~ 3 ,f 2 ) = -6 -e' ’ 


where S 2 is the standard 2-dimensional representation of SL 2 (C). 

(iv) For e, e' such that e(|, f ® x~ 3 , f 2 ) = e ■ e', f/ie theta correspondence ft ha we ye , (n) gives a 
bisection 

n* < — > n 0 n W . 


(v) 


For e, e' such that e(^, f (g> x 3 > f 2 ) = ~ e ' £/ > correspondence ft ha 6h ye i (ft) gives an 

injection 


n 0 ^a 11^(0). 


Write 


• Sfj, = (fL/21j)a\ 

• -Sen^) = (Z/2Z)ai */ e(\,f®x^,f 2 ) = £ • e' 

• = (Z/2Z)ai x (Z/2Z)a 2 if e(\,f® x -3 , = -e ■ e' 

where 

fi( x ) = fC^E/Fitix)). 

(Note that 6 s (f) is a square-integrable L-parameter ofU(W |) and the summand (h/2 r L)a 2 of Sqsu\ arises 
from the summand x ^ £2 * n ® s (f)-) 

Since we are only dealing with odd dimensional spaces, there are three canonical bijections 


• J^(f) : n 0 <—> Irr (S#) 

• J^(0 n ($) : U enW <—► Irr(5 0 n W ) 

. J^(0 a (0)) : <—>■ Irr(5„. w ). 

Using these maps, the following bijection and inclusion 

Irr (Sf) i —» Irr(S , 0 n ((/)) ) 
r] ha 0 n (r]), 


Irr(S'^) Irr(S' 0sW ) 

77 HA 0 s (77) 

induced by the theta correspondence can be explicated as follows: 

(3.2) O n {v)(a 1 ) = ri(ai) • e(^, f ® x“ 3 , fi), 

(3.3) 0 s ( 77 X 01 ) = z?(ai) ■ e(^><g>x _3 ,'i/’f ; ), 0 2 (rj)(a 2 ) = -1. 

Remark 3.3. Note that 0 n ((/>) is a non-generic L-parameter. Gan and Ichino (Proposition B.l in Appendix 
in El) proved that an F-parameter is generic if and only if its associated L-packet 11^ contains a generic 
representation (i.e. one possessing a Whittaker model). Together with the Corollary 4.2.3 in [13] . which 
asserts that all elements in II gnr^ have no Whittaker models, we see that 0 n (f) is a non-generic L- 
parameter. 
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3.4. Case (ii). Now we shall consider the theta correspondence for U(V^ £ ) x U(W|). The following 
summarises some results of 0 , 0 , which are specialised to this case. 

Theorem 3.4. Let f> be an L-parameter for U(4^ ± ). Then we have: 

(i) Suppose that f> does not contain x 3 - 

(a) For any 7r G 11^ and any e € {±1}, 0^ we y € i (n) is nonzero and 9^ Wf y e i (tt) has L- 
parameter 

0(0) = (f>® x -1 ) ©x 2 - 

(b) For each e = ±1, the theta correspondence n i-a 9^ w< , ve i (tt) gives a bijection 

(ii) Suppose that f> contains x 3 - 

(a) For any tt £ 11^, exactly one of Q,^ w + y e '(n) or Q^ w - ye i( tt) is nonzero. 

(b) If 0^ we y e ' (tt) is nonzero, then 9^ we y e > (tt) has L-parameter 

8(f)) = (f) ® X~ l ) ® X 2 ■ 

(c) The theta correspondence i r i-a 6^ we y f j (tt) gives a bijection 

(iii) We have fixed a bijection 

J^E((j)) :: 4—> Irr(5<^), 

where 

4> E (x) = iA(|Tr E / F (5x)) 

and there is the bijection 

■■ n e«>) *—> 

• If <j) does not contain x 3 , we have 

&9(4j = x (Z/2Z)6i, 

where the extra copy ofTL/TL of Sgu^ arises from the summand x 2 in 9(f)). 

Then for each e, using the above bijection J and J^e, one has a canonical bijection 

Irr(5 0 ) 4 —■> Irr e (S’ 0 ( 0 )) 
r) i —* 9(rj) 

induced by the theta correspondence, where Irr^SW^)) is the set of irreducible characters rf 
ofSgu) such that rj'(zgu)) = e and the bijection is determined by 

^0?) I = v- 

• If j) contains x 3 > then f)®x~ l contains x 2 > and so 

^0(4>) ^<f>- 

Thus, one has a canonical bijection 

Irr(SV) 4—> Irr(5 0(9i )) 
rj i—> 9(r}) 

induced by the theta correspondence and it is given by 

0 0?) = V- 
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(iv) If tv is tempered and 0^ w€ y f < (n) is nonzero, then 0^ W£ y e > (n) is irreducible and tempered. 


4. Main Theorem 


In this section, we prove our main theorem. To prove it, we first state the precise result of Beuzart- 
Plessis which we shall use in the proof of Theorem [nfi 

Theorem (B) n . Let (j) = ix i l^ be a tempered L-parameter of U(V± +1 ) x U(V±) and write 
S^n+i) = Y\ i (Z/2Z)ai and S^n) = nj(Z/2Z)hj. Let A : U(V±) U(V± +1 ) x U(V±) be the diagonal 

map. Then for tt(t/) G Ilf ± = II± (n+1) x II± n) where p G Irr(5 0 ) = Irr(5 0 ( „+i)) x Irr(S^ ( „)), 

= 1 h = 9* where 

(y*{ai) = e(±,<^ n+1) ®0 (n) ,^ 2 ); 

= e(|, 0 (n+1) 

where if^ 2 ( x ) = TrE/iK&p))- 

Theorem 4.1. Let (jPI, be tempered L-parameters ofU(V±) and U(V±) respectively and suppose 
that cj)^ does not contain x~ 3 - Let 

6» Tl (0 (1) ) = x| • ll©0 (1) -X~ 2 ©X| ' | £ 5 , 

0 S (0 (1) ) =</> (1) -x _2 ©X^52 

6 e the two L-parameters ofU(W±) appearing in \3.1\ ) and let 

O(^) = <^ (2) ®x©x -2 

be the L-parameters ofU{W 3 ) appearing in Theorem \3-4\ (ii), in which x Is replaced by \ _1 - 
Write 


• S<j>W ~ (^(i)) — (Z/2Z)ai; 

• ^9 3 ((pW) = ^<j>W x (^/2Z)a2; 

[{Z/2Z)b\ if is irreducible-, 

^ J |(Z/2Z)6i x (Z/2Z)&2 if ©02^ *s reducible 

• ^(^(a)) = ^( 2 ) X (Z/2Z)ci 


where c± comes from the component x 2 0 / 9{(f>( 2 i). 

We use the fixed character if to fix the local Langlands correspondence for II^( 2 ) o- Irr(,S .( 2 )). 

For x = n,s, let 

9 x i^ 1 \^ 2 i) = e x {(j) W ) x 6 {(f>W) 

be a L-parameter of G± = U(W±) x and Tr x (ri ) G ^ (2) ^ a representation of a relevant pure 

inner form of G 3 . Then, 

Horn AU(W e)( 7 ^( 77 ),^,^) / 0 ri = //♦ 
where ??♦ G Irr^^i)^))} = Iii(S ex ^i^) x Irr(5 0(0 ( 2)) ) is specified as follows; 


2 Recently, Gan and Ichino ([9]) extended Beuzart-Plessis’s work to the generic case relating it to (FJ) case. 




12 


JAEHO HAAN 


(i) When q^ is irreducible, 

Vn(ai) = ©x -3 ,^) -e(|,^ (1) © </> (2) , V’f) 

< V%(h) = e( 5 ,^> (1) ®^ ( 2 ) ,^f) 

, ? ?n(ci) = e(i, 0 W ©x -3 ,^®) 

'vt(a 1) = e(±, 0 (1) ©x -3 ,'*/#) -e(5,^ (1) ©^V#) 

< hfM = -1 

*7?(&i) = e(i,^ (1) © 
k »7?(ci) = -e( 5 , 0 (1) ®x~ 3 ,^f) 

(ii) WTien q i>( 2 ) = is reducible, 

' ? 7n(oi) = e(|,</> (1) ©X -3 ,^) -e(i,^> (1) © <£ (2) , V#) 

< vt(bi) = e(i,^> (1) 

^ 2 ) = e(3,^ (1) ®^2 2) »^f) 

J7n(ci) = e(i, 0 W ©x -3 ,^®) 

^(oi) = e(^,</> (1) ©X -3 ,^) -e(i,<^ (1) ©(^Vf) 
vt(a 2 ) = -1 

< »7?(&i) = e(i^ (1) ® ^V’f) 

»7?(&2) = e(5,^> (1) © ^2 2) >^f) 
k »7?(ci) = -e(|,(/> (1) © X~ 3 ,V#) 

Furthermore, 

dim c Horn au(M /| ) ( 7 t :E (? 7 *),cj^ M /|) = 1 

Remark 4.2. When x = n or s, we have rjt( z e x ( < l>( h)) = vt( z e(<p( 2 ))) so that 77 * always corresponds to a 
representation of a relevant pure inner form of G 3 . 


Proof. For each x = n, s, we first prove the existence of some € {±1} and tt^( 77 ) € 11^’ ^ (2) ^ such 

that 

Hom AU ( W |*)(7r x (7/),cd^jy|*) / 0. 

For a € i ?x , let L a be the 1-dimensional Hermitian space with form a ■ N e/f- Then 

F+/1/+ ~ Vf /Vf ~ L_l 

We consider the following see-saw diagram : (e, e' will be determined soon) 


(4.1) U(W|) x U(W|) U(F/) 

U(W|) 11(1//) x U(L_i) 

In this diagram, we shall use three theta correspondences : 

(i) U(Vf ) x C/(IF 3 ) relative to the pair of characters (x/x 3 ); 

(ii) U(Vi e ) x [/(IF|) relative to the pair of characters (x,x 3 ); 
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(iii) U(L_i) x U(W|) relative to the pair of characters (x 1 ,X 3 )- 
By (B) i, there is a unique e' G {±1} and a unique pair of components characters 

(r?2,//i) € Irr e/ (5 (( ^(2) )v ) x Irr 6 '(S^ W y) 

such that 

Hom AC/(U 1 £, )( 7r ^ 2 ) 0 7r ( , 7i)> c ) ^ °- 

Moreover, e' = 771 ( 01 ) = e(^, <8 ,^ 2 ) = e (|> 0^ ® 0®, V’f'). 

By Theorem 13.41 (i), (iv) and Theorem 4.1 in [2j,0^ ^ £ ' (@^ ^ e /( 7 /( 772 ))) is nonzero for any e G 

{±1}. Since Q^^eye' (n(m)) E 0 v,,u/,W| ( 0 v>,VF|,u/ (^M)) is the maximal &^ W eye' (7r(7/ 2 ))-isotypic 
quotient of u^y 2t w 3 and (//(%)) ^/r(%) is a 0^, ^ (vr(7) 2 ))-isotypic quotient of 7 /( 772 ) 

should be a quotient of 0^, ^ [Q^ w . v ., ( 7 /( 772 ))). By Proposition 5.4 in [2], Q^ v ,, w , (Q^ w , y ,, ( 7 /( 772 ))) 
is irreducible and thus we have ^ ( 0 p,w" y/ ( vr ( r / 2 ))) = 7r ( 7 ? 2 )- 

Since 

+ 0, 

by the see-saw identity and Remark 13.11 we have 

Uom AU{Wi) {% >w§ yj(* w (m))®U 4 ,,w§> Q i, l wi,V£'( 7/(772))) + 0 

and since 0 ? . ^ ^ £ /( 7 /( 772 )) and are admissible, we have 

Hom AU(W j) (Q^wi.Vf'^^)) 0 7^ 0. 


By Theorem 13.21 (iii) and Theorem 13.41 (i), the L-parameter of 0 , „ e £ v ,.' (t v (//i)) <8 0^ , ( 7 r ( r ? 2 )) is 

' ’ K 3 ’ K 1 V' j' 3 5» 2 

f0 n (0 (1) ,^ (2) ) if e = e(±,</>W < 8 x _ 3 ,V#) ■ e(i<^ (1) 

(^(^W, <j!>( 2 )) if e = — e(|, t/^ 1 ) <8 x - 3 , ip 2 ) • e(|, <j>^ (8 (j)^ 2 \tj} 2 ) 

and by Theorem 13.21 (v), Theorem 13.41 (iii). we see that their associated component characters are 77 ^, 77 * 
in each cases. 

Next we shall prove that these are the unique representations which yield Fourier-Jacobi model in each 
L-packets n 0 „^(i)^( 2 )) and ^( 2 )). 

Since 9 s {(j)^ l \ 4>^) is tempered L-parameter, the uniqueness easily follows from (FJ )3 in this case. There¬ 
fore, we shall only consider the non-tempered L-parameter 9 n (<p^\ 

Let 7/2 <8 7/1 G n^ (1) ^ (2)) = n^ n(0(1)) x n^ (2)) be a representation satisfying 

Hom AU (w|)( t /2 ® 7 /i,w^w|) / 0 

and in turn 

Hom AU ( W -« ) ( 7 r 2 ®w^ W |, 7 /) / ) + 0 . 

(The existence of such 7 r 2 <8 7/1 was ensured by the previous step.) 

By Theorem 13.21 (iv), we can write 7 r 2 = 0^ we ye'{n^) for some 7/^1 G n^ (1) where 

e' = Ge(^ ( 1 ) ®x" 3 ,^)- 
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Then by applying the see-saw duality in the see-saw diagram in (14.11) . one has 

Hom AU(w -|)(7r 2 ®u^ W e,TTi) ~ / 0 

where ir™ = 0^ >W| K). 

Note that ^ 0 and so it has tempered L-parameter (<^>( 2 i) v . 

Then by the (B)i, {'n ly2 \ vr^) is the unique pair in the T-packet n^( 2 )j V x n^p) such that 

Hom c/(y 1 £, )( 7r(2) ’ 7r(1) ) ^ 0 

and so should be (0 ^,^'(tt (1) ), 0^ (tt (2) ))- 

This settles down the uniqueness issue. 

□ 


Remark 4.3. When the T-parameter cj>( 2 i of U(V±) contains \ 3 , we can write 
L- parameter f >o of U(V±). Then, we set 


and 


e(^) 


3 • X 2 if 4 = X 3 , 

4>o • X © 2 • X -2 if 00 ± X -3 




(Z/2Z)&! if 4 = X" 3 , 

(Z/2Z)6i x (Z/2Z)ci if 4 + X" 3 - 


(j>o 0 X 3 for a 


If one develops a similar argument in this case, one could also have a recipe as in Theorem 14.41 for 
non-tempered case. However, we need some assumption on the irreducibility of the theta lifts because we 
cannot apply Proposition 5.4 in |2]. 


Theorem 4.4. Let the notations be as in Thorem \f.l\ and assume this time that 4>^ contains x 
Assume that for ir € if yU M /e( 7r ) is nonzero, it is irreducible. 

Then, 

Hom AU(w ,|)(7r n (v),^,wi) + 0 r) = rj* 
where rj* € lTi(S 0n ^i) ^ (2)) ) = Irr( 1 S , e „ ( ^ ( i )) ) x In:(5 0( ^ (2)) ) is specified as follows; 


• When 4>o = X ? 

ivt( a i) = e (|> (1) 

\vn(bi) = e(i, 0 (1 ) ®X“ 3 ,V#)- 

• IT/ien 4>o 7 ^ 

Vni a l) = ® 00, ^f 7 ) 

< Vn (^1) = ® ^0,^1) 

^n(ci) = e(|,<?!>W ®x _ 3 ^2 £ )- 


e 

Proof. We first prove the existence of some e € {±1} and TT n (rj) € n ’ (1) ^ (2) such that 

Hom AU (H/|) (7r n (r/), + 0. 

By (H)i, there is a unique e r £ {±1} and a unique pair of components characters 

(f72,77i) € Irr £/ (5(^(2) )v ) x Irr e '(5 (0 (i) )v ) 
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such that 

Hom A(/ W ^te) ® + o. 

Moreover, 772 ( 61 ) = e((<^ ( ^ 1 ^) v <g> (<^>o) v , ^- 2 ) = ® ^ 0 ,^ 2 ) ancl 

e' = hi(ai) = e(^,(0 (1) ) V ® (</> (2) ) V ,V ; - 2 ) = e(^> (1) ® 

By Theorem 13.41 (ii) and (iv), ^ ^( 7 /( 772 )) is a nonzero irreducible representation of £/(WJ) for some 


e G {±1} and by Theorem 4.1 in [2], 0 

( 0 , 


irreducible and we have 0 


ip,v/ ,w| 


’( 7 /( 772 ))) is nonzero. So by our assumption, it is 




(nfa))) = 


Since 

Hom AI/(Vi«')( 7r ( , / 2 )’ 7rV ( , 7l)) ^ °> 
by the see-saw identity and Remark 13.11 we have 

Hom A[/(W|) (©^^yP (/r v ( 771 )) 0 ^ ^( 71 ( 772 ))) + 0 

and since 0^ w< , yp ( 7 /( 772 )) and W e are admissible, we have 

Hom A[/(W|) {@^ W eye'{Tr y (m)) ® ©J,iv|,yP 2 )),w w ) + 0 . 

Write ©^w^yP^M) = ^( 773 ) for some 773 G rL^mjv)- 

If </>o = X -3 , then 773 (^(^v)) = 773(3 • 61 ) = 773 ( 61 ) and if 7^ X -3 , then = 773 ( 61 ). 

Thus in both cases, we have 


1 


e = 


r ?3(%((0(2))v ) ) = 773(61) = 772(61) = e(—, 0 (1) <g> </>o,V>f 


Since 


e ' = e(^,0 (1) ® 0 (2) ,7Af) = e(^,0 (1) ® ^o.V’f) ■ e(^ (1) ®X ^f), 


we have e ■ e' = e(^, 0I 1 ! <g> x 3 , t/tf) an d so by Theorem 13.21 (hi) and Theorem 13.41 (i), the L-parameter of 

%,wi,v/ (^M)® 0^, y pM%)) is 0 n (<£ (1) ,<£ (2 >). 

Furthermore, by applying Theorem 13.21 (v). Theorem 13.41 (iiil. we see that the associated component 
character of 0 , „, e „ £ / (7r v ( 771 )) (8) 0^ , / p( 7r (?? 2 )) is exactly 77 ^ in each cases and it proves the existence 

part. The proof of the uniqueness part is essentially same as the one in Theorem 14.11 □ 

Remark 4.5. It is remarkable that for the supercuspidal L-parameter 9 s with 9{(f>^) as above, 

the recipe, which is sugegsted in (FJ) 3 , does not occur from the theta lift from U{V±) and U(V±). This 
is quite similar with the Proposition 4.6 in [13], which concerns the non-generic aspect of Bessel case of 
the GGP conjecture. 
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